GH-44183: [C++][Python] Support run-end encoded struct, list (view), large list (view) and map values - #50534
GH-44183: [C++][Python] Support run-end encoded struct, list (view), large list (view) and map values#50534BenMagyar wants to merge 3 commits into
Conversation
Adding the encode path for nested-value encoding for List, FixedSizeList and Struct arrays
Adding the decode path for nested-value encoding for List, FixedSizeList and Struct arrays
|
|
BenMagyar
changed the title
|
|
BenMagyar
changed the title
|
|
1 similar comment
|
|
BenMagyar
changed the title
|
|
| add_kernel(Type::LARGE_STRING); | ||
| add_kernel(Type::LARGE_BINARY); | ||
| add_nested_kernel(Type::FIXED_SIZE_LIST); | ||
| add_nested_kernel(Type::LIST); |
There was a problem hiding this comment.
Can we also handle LARGE_LIST and LIST_VIEW?
(perhaps MAP too)?
There was a problem hiding this comment.
extended out to large list, list view, large list view and map
BenMagyar
changed the title
|
|
1 similar comment
|
|
2 participants
Rationale for this change
From #44183 - creating run-end encoded cols that contain list or struct values is unsupported. Adding support for both the encode and decode paths.
What changes are included in this PR?
List,ListView,LargeList,LargeListView,Map,FixedSizeListandStructvalues in therun_end_encodeand therun_end_decodepaths.Are these changes tested?
Are there any user-facing changes?
There are but they are not breaking. Currently the encode path throws that it is unsupported on one of these types. We are adding support.